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Abstract 

In this paper, we investigate threshold effects associated with swapping of signal and noise subspaces 
in estimating signal parameters from compressed noisy data. The term threshold effect refers to a 
sharp departure of mean-squared error from the Cramer-Rao bound when the signal-to-noise ratio falls 
below a threshold SNR. In many cases, the threshold effect is caused by a subspace swap event, 
when the measured data (or its sample covariance) is better approximated by a subset of components 
of an orthogonal subspace than by the components of a signal subspace. We derive analytical lower 
bounds on the probability of a subspace swap in compressively measured noisy data. These bounds 
guide our understanding of threshold effects and performance breakdown for parameter estimation using 
compression. As a case study, we investigate threshold effects in maximum likelihood (ML) estimation 
of directions of arrival of two closely-spaced sources using co-prime subsampling. Our results show the 
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impact of compression on threshold SNR. A rule of thumb is that every doubling of compression ratio 
brings a penalty in threshold SNR of 3 dB. 


I. Introduction 

The performance of many high resolution parameter estimation methods, including suhspace and maxi¬ 
mum likelihood methods, may suffer from performance breakdown, where the mean squared error (MSE) 
departs sharply from the Cramer-Rao hound at low signal-to-noise ratio (SNR). Performance breakdown 
may happen when either the sample size or SNR falls below a certain threshold 111. The main reason 
for this threshold effect is that in low SNR or sample size regimes, parameter estimation methods lose 
their capability to resolve signal and noise subspaces. As a result of this, one or more components in 
the orthogonal (noise) subspace better approximate the data than at least one component of the signal 
subspace, which in turn leads to a large error in parameter estimation O. This phenomenon is called a 
subspace swap. 

In this paper, we address the effect of compression on the probability of a subspace swap. In other 
words, we ask what effect compression has on the threshold SNR at which performance breaks down. 
To answer this question, we derive a lower bound on the probability of a subspace swap in parameter 
estimation from compressed noisy measurements. We consider two measurement models. In the first- 
order model, the parameters to be estimated modulate the mean of a complex multivariate normal set of 
measurements. In the second-order model, the parameters modulate the covariance of complex multivariate 
measurements. For these models, we derive analytical lower bounds on the probability of a subspace swap 
in compressively measured noisy data. These bounds guide our understanding of threshold effects and 
performance breakdown for parameter estimation using compression. As a case study, we investigate 
threshold effects in the maximum likelihood estimation of directions of arrival of two closely-spaced 
sources, using co-prime subsampling of a uniform line array. Co-prime sensor array processing was 
introduced recently by Vaidyanathan and Pal El-IU as a sparse alternative to uniform line arrays. The 
concept was extended to sampling in multiple dimensions in subsequent papers by the same authors. 
In one dimension, the idea is to employ two uniform line arrays with spacings of mi and m 2 in units 
of half-wavelength, where mi and m 2 are co-prime. Our results show the impact of compression on 
threshold SNR, and can be used as a tool to predict the threshold SNR for different compression regimes 
in maximum likelihood estimation. Our simulation results indicate that compression brings a cost of 
about lOlog^QC dB in threshold SNR, where C is the compression ratio. 
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Co-prime sampling is just one type of sampling to which our results apply. Our prohahility hounds are 
tail prohahilities of F-distrihutions, and they apply to any deterministic linear compression. 

Other studies have also addressed the performance breakdown regions of high resolution parameter 
estimation methods. In |[T|, approximation of the prohahility of a suhspace swap in the Singular Value 
Decomposition (SVD) is investigated. In |I2|| lower hounds on the prohahility of a suhspace swap are 
derived for the problem of modal analysis. In |0 a lower bound on the probability of a subspace swap 
is derived by considering the separation of the estimates of signal and noise eigenvalues. In Q, the 
authors propose a method to reduce the subspace leakage for the direction of arrival (DOA) estimation 
problem using root-MUSIC algorithm ||8l. In llQl- lfTTI . perturbation analysis of the SVD is carried out 
to study the performance of subspace based methods for parameter estimation, when subspace leakage 
happens between signal and noise subspaces. Performance breakdown of maximum likelihood has been 
studied in ifT^ - lfT^ by perturbation analysis using an asymptotic assumption on the number of snapshots. 
More perturbation analysis may be found in the papers by Vaccaro et al. ifTTl - lfTOl . In |[20ll . performance 
breakdown regions have been studied in the DOA estimation problem using asymptotic assumptions on 
the number of antennas and number of samples. It is shown that while a subspace swap is the main 
source of performance breakdown in maximum likelihood, earlier breakdown of MUSIC is due to the 
loss of resolution in separating closely-spaced sources. 

II. Measurement Model 

In the following subsections, we consider two models for the random measurement vector y G C"^. In the 
first-order model, the parameters to be estimated nonlinearly modulate the mean of a complex multivariate 
normal vector, and in the second-order model the parameters nonlinearly modulate the covariance of a 
complex multivariate normal vector. 


A. Parameterized Mean Case 

Let y G C" be a complex measurement vector in a signal plus noise model y = x(0) -|- n. Here, we 
assume that n is a proper complex white Gaussian noise with covariance cr^I and x(0) is parameterized 
by 0 G C^, p < n. We assume that the parameters are nonlinearly embedded in x(0) as x(0) = K(0)q, 
where the columns of K(0) = [k(0i) k(02) • • • k(0p)] define the signal subspace, and a G is a 
deterministic vector associated with the mode weights. Therefore, y is distributed as CAA„(K(0)q;, u^I), 
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and the parameters 0 £ to be estimated nonlinearly modulate the mean of a complex multivariate 
normal vector. Assume we compress the measurement vector y by a unitary compression matrix = 
where $ G d^mxn^ p < m < n. Then, we obtain w = which is distributed as 
CAAm(z(0), (T^I), where z{6) = ’Jfx(0). We form the data matrix W = [wi W 2 • • • wm], where Wj’s 
are independent realizations of w. To specify a basis for the signal subspace and the orthogonal subspace 
in our problem, we define H(0) = ’J'K(0) = [h(0i) h(02) ••• h(0p)], with h(0j) = The 

singular value decomposition of H^xp {p < is 

H = U'EV^ (1) 


where 


U G : UU^ = U^U = I 


V G : VV^ = V^V = I 


E G : S = 


0 


T,p = diag(cri,cJ 2 , ...,crp), fii > cj 2 > ... > fXp 


( 2 ) 


Now we can define the basis vectors from U = [ui, U 2 ,..., Up|up+i,..., u^] = [Up|Uo], where (Up) 
and (Uq) represent signal and orthogonal subspaces, respectively. The columns of Up and Uq can be 
considered as basis vectors for the signal and orthogonal subspaces, respectively. 


B. Parameterized Covariance Case 

Assume in the signal plus noise model y = x + n, the signal component x is of the form x = K(0 )q:, 
where the columns of K(0) = [k(0i) k(02) ••• k(0p)] are the modes and ct G is the vector 
associated with the random mode weights. We assume ct is distributed as CA/’p(0, Rq.q.). Therefore, 
R- 2 ;x(^) = K(^)RQ;aK^(^) IS parameterized by 0 G C^. We assume n is a proper complex white 
Gaussian noise with covariance ct^I, and x and n are independent. Therefore, y is distributed as 
CAA„(0, Ryy(0)), where Ryy(0) = K(0)RQctK^(0) + Such a data model arises in many ap¬ 
plications such as direction of arrival and spectrum estimation. 

Assume we compress the measurement vector y by a unitary compression matrix 'J' = 
where $ G < n). Then, we obtain w = 'J'y which is distributed as 

w ~ CAAm(0,Rww) (3) 
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where Rww = + (T^I. We form the data matrix W = [wi W 2 • • • wm], where 

Wj’s are independent realizations of w. Each of these i.i.d. realizations consists of an i.i.d. realization of 
Yi, compressed hy a common compressor for alH = 1,2,..., M. We may define the signal covariance 
matrix after compression as 

Rzz = 

= H(0)R«„H^(0), (4) 

where H(0) = [h(0i) h(02) • • • h(0p)], and h(0j) = Now, we can write the singular value 

decomposition of Rzz and Rww as 

Rzz = UAU^ 

Rww = U(A + ( 5 ) 

where U and A are defined as 


U G C™""™ : UU^ = U^U = I 


A G C™''™ ; A = 



0 

0 


Ap = diag(Ai, A2,Ap), Ai > A2 > ... > Ap. ( 6 ) 

Assuming Rzz has rank p, the unitary matrix U can he written as U = [ui,U 2 , ...,Up|up+i, ...,Um] = 
[Up|Uo]. Here (Up) represents the signal suhspace and (Uq) represents the orthogonal suhspace which 
completes assuming p < m < n. Figure [T] gives a geometrical representation of (j^. 



Fig. 1: Signal and noise suhspaces. 


May 28, 2015 


DRAFT 








PAKROOH et air. THRESHOLD EFFECTS IN PARAMETER ESTIMATION FROM COMPRESSED DATA 


6 


III. Bound on the Probability of a Subspace Swap after Compression 

To bound the probability of a subspace swap for the compressed measurements W, we define the 
following events: 

• E is the event that one or more modes of the orthogonal subspace resolve more energy in W than 
one or more modes of the noise-free signal subspace. Therefore, E may be written as 

E = ^^g=iE{q), (7) 

where E{q) is the following subset of the subspace swap event E, 

min tr(W^PHAW) < max tr(W^Pu„BW), (8) 

Aeip,, BeC<"-p)x'! 

and Xp g is the set of all p x g slices of the identity matrix Ip. Here, the columns of H are the modes 
defined in Secfion and A selects q of the columns of H. 

• X is the event that the average energy resolved in the orthogonal subspace (Uq) is greater than 
the average energy resolved in the noise-free signal subspace (Up) (or equivalently (H)). Then, the 
following bounds establish that X is a subset of X(l), which is in turn a subset of the swap event 
X: 


min tr(W^Ph.W) < -tr(W^Pu W) 

l<i<p ‘ p ’’ 

< ^^tr(W^PuoW) 
m — p 

< max tr(W^Pu^W) 

p+l<2<m 

< max tr(W'^PunbW). (9) 

beC("-Dxi 

• G is the event that the energy resolved in the apriori minimum mode hmin of the noise-free signal 
subspace (H) (or equivalently (Up)) is smaller than the average energy resolved in the orthogonal 
subspace (Uq). For the parameterized mean measurement model, we define hmin as 

hmin= argmin |h'^z(0)p, (10) 

he{h(0i),h(02),...,h(0p)} 

and for the parameterized covariance measurement model as 

hmin = argmin |h^Rzz(0)hp. (11) 

he{h(0i),h(02),...,h(6»p)} 
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Then, the following hounds establish that G is a subset of -E(l), which is in turn a subset of the 
swap event E\ 


min tr(W^Ph,W) < tr(W^Ph_„W) 
l<i<p ^ 

< ^^tr(W^PuoW) 
m — p 

< max tr(W^Pu^W) 

p+l<2<m 

< max tr(W^Pu„bW). (12) 

bgC("-P)xi 

Since events F and G are subsets of event E, their probabilities of occurrence give lower bounds on 
the probability of a subspace swap, Pgs = P{E). We use these events to derive lower bounds on the 
probability of a subspace swap for the two data models given in Section 


A. Parameterized Mean Case 


For the parameterized mean measurement model discussed in Section II-A we start with event F and 
define 


1 


-F = 


m — p 


Puo - rPu„ 


-] 

p 


(13) 


where Pu,, = UpUp is the orthogonal projection onto the signal subspace and Pup = UqUq is the 
orthogonal projection onto the orthogonal (noise) subspace. According to the definition of event F we 
can lower bound the probability of a subspace swap Pgg as 

Pss > P(tr[W^TFW] > 0) (14) 


Therefore, we have 


Pss > P(tr[W^Ti7W] > 0) 

tr[W^UpU^W]/2p 


= Pi 
= P{ 


tr [W^UoU^W] /2(m - p) 

E.=il|Ufw*||i/2p 


< 1 ) 


l|U^Wi||2/2(m-p) 


< 1 ). 


(15) 


Here, the Wj are independent and identically distributed as 


Uf Wi ~ CAAp(U"z(0), cj^I) VI < f < M. 




(16) 
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Therefore, ||U^Wj|||/(T^ ~ X 2 p(ll^(^)ll 2 /^^)> which is the distrihution of a complex noncentral chi- 
squared random variable with 2p degrees of freedom and noncentrality parameter ||z( 0 )|| 2 /<t^. Also, 
since (Up) and (Uq) are orthogonal, we can conclude that in (151, each HU^WjlH/cr^ is independent 


of ||U„ w,llo/cT^ and is distributed as Hence, the term htth ^112 n/ -\ is the ratio of two 

independent normalized chi-squared random variables and is distributed as F 2 pM, 2 {m-p)M{\\'^{^)\\^/ 
which is a noncentral F distribution with 2pM and 2{m — p)M degrees of freedom and noncentrality 
parameter ||z(0)|||/(T^. Thus, the probability of a subspace swap after compression is lower bounded by 
the probability that a F 2 pM, 2 (m-p)M {\\'^{'^)\\\/distributed random variable is less than 1. When there 
is no compression, this lower bound turns into the probability that a F 2 pM, 2 {n-p)M{\\'^{'^)\\‘ 2 /random 
variable is less than 1 . 


For event G, we define 


Here, we define pmin = 


Here, we have 


Tg = 


1 


m — p 


PUo - Ph„ 


Therefore Ph„.„ = PminPmin^ and we have 


Pss > P(tr[W^TGW] > 0) 


= P{ 


tr [W^UoU^W] /2{m - p) 

E*=lllP^.nW.|li/2 


Ei=i l|U?Wi||2/2 (m-p) 


< 1 ). 


Pmin^i ~ CAA(p^^„z(0), fj^I) VI < i < M. 


(17) 


(18) 


(19) 


Therefore, ~ X 2 (|Pmm^(^)P/'^^) which is the distribution of a complex noncentral chi- 

squared random variable with 2 degrees of freedom and noncentrality parameter |p^^^z(0)p/cr^. Thus, 

y'" \\pH -w.||2/2 

with the same type of arguments as for event F, we can conclude that the term T 9 ^ is 

^ E"i ||U"wd|i/2(m-p) 

distributed as P 2 M, 2 (m-p)M(|Pmm^(^)P/'^^)’ which is a noncentral F distribution with 2M and 2{m — 
p)M degrees of freedom and noncentrality parameter |p^^^z(0)p/(T^. When there is no compression, 
this turns into the probability that a -P 2 M, 2 (n-p)M(l'^mm^(^)P/'^^) random variable is less than 1. Here, 
t^min = II^"“" 11 ^ , and kmin is the apriori minimum mode of the signal subspace before compression. 


B. Parameterized Covariance Case 


For the parameterized covariance measurement model discussed in Section II-B we start with event 
F. In this case, the columns of the measurement matrix W are i.i.d. random vectors distributed as 
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CAA(0,Rww)> and similar to the mean case we have 

Pss > P(tr[W^Ti.W] > 0) 

^ tr[W^UpUfW]/2p ^ 

Hr[W^UoU^W]/2(m-p) ’ 
E.^il|Ufw.||i/2p 
E^il|U^w.||i/2(m-p) 

Here, the U^Wj are i.i.d. and distributed as 


( 20 ) 


Uj^Wj ~ CMp{0, Ap + cr^Ip) VI < i < M. 


( 21 ) 


Therefore we can write 


l|Uf Willi = j]](E + cr^)pi, 

i=l 

where pi’s are i.i.d. random variables, each distributed as xi- Therefore, 


( 22 ) 


M 




2 = 1 


2=1 


(23) 


where ^j’s are i.i.d. random variables, each distributed as xIm- we can write Ei^i llU^WjUi = 
where u is distributed as X 2 M{m-p) independent of the ^i’s. Therefore, we have 




= Pi 


E,=il|Uo^w,||i/2(m-p) 

Ef=i(l + 


< 1 ) 


< 1 ). 


(24) 


v/2M{m — p) 

Here, the term is distributed as GF[{1 + ^), ..., (1 + ^); 2Mp; 2M{m—p)], which 

is the distribution of a generalized F random variable lf2ll . Thus, the probability of a subspace swap 
in this case is lower bounded by the probability that a GF[{1 + ^),..., (1 + ^); 2M; 2M{m — p)] 
random variable is less than 1. Without compression, this turns into the probability that a GF[(1 + 
^),..., (1 + ^); 2Mp; 2M{m — p)] random variable is less than 1. Here Aj’s are the eigenvalues of 
the signal covariance matrix Rxx before compression. 
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We can also derive the probability of the event G for the parameterized covariance measurement model. 
In this case we have 


Pss > P(tr[W^TGW] > 0) 

E,=lllP^.nW*|li/2 


= P{-, 




< 1), 


(25) 


where pmin = 

Here, p^in^i distributed as 


, and hmin is the apriori minimum mode of the signal subspace given by ( 111 . 


Pmin^i ~ C-^(0, r) VI < i < M, 


where r = p^-^RwwPmm- Therefore, 


M 




~ X2M) 


(26) 


(27) 


i=l 


and we have 


E^^lllP^.nW.||^/2 

E*=i l|U^Wi||2/2(m-p) 


Pss > P{- 


< 1 ) 


a 


= T’(^<-), 


(28) 


where V is distributed as F 2 M, 2 M{m-p)^ which is a central F random variable with 2M and 2M{m — p) 
degrees of freedom. Without compression, this turns into the probability that a F 2 M, 2 M{n-p) random 
variable is less than i, where f = K^-.^'RyyKmin, i^min = ||f™[[j> and k^in is the apriori minimum 
mode of the signal subspace before compression. 


Remark 1: In Sections ( III-A[ ) and ( |III-B ), we have derived lower bounds on the probability of a subspace 
swap for the case that ^ is deterministic, as in standard or co-prime subsamplings. In 

the case that 'J' is random, these probability bounds would have to be integrated over the distribution of 
'J' to give lower bounds on marginal probabilities of a subspace swap. For example, for random and 
for the subevent F we have 


= j P{E\^)P{<i!)d'^ > J P{F\'^f)P{^)d^ 


(29) 


where P(F|'J') is given in Sections (III-A) and (III-B) for the parameterized mean and parameterized 


covariance measurement models, respectively. For the class of random compression matrices that have 
density functions of the form that is, the distribution of $ is right orthogonally invariant, 'I' is 

uniformly distributed on the Stiefel manifold V^(C’^) l[22l . The compression matrix $ whose elements 
are i.i.d. standard normal random variables is one such matrix. 
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IV. Simulation Results 

In this section, we present numerical examples to show the impact of compression on threshold effects 
for estimating directions of arrival using a sensor array. We consider a dense uniform line array with n 
elements at half-wavelength inter-element spacings. We compress this array to m dimensions using co¬ 
prime suhsampling. In co-prime compression, we uniformly suhsample the dense array once hy a factor 
nil and once hy a factor m2, where mi and m2 are co-prime. We then interleave these two suharrays 
to form the co-prime array of mi -|- 2m2 — 1 elements. We note that although we are compressing the 
array hy a factor n/m for the co-prime array, the dense and the compressed arrays still have the same 
total aperture. The geometry of the dense and co-prime arrays are shown in Figure We consider two 
point sources at far field at electrical angles 0 i = 0 and 62 = vr/n. We set the amplitudes of these 
sources ai = a 2 = 1. The Rayleigh limit of the dense array in electrical angle is 211 jn. Therefore, in 
our examples the two sources are separated hy half the Rayleigh limit of the dense array. We present the 
results for the parameterized mean and parameterized covariance cases. 

A/2 

^1 1^ 

0 • • • • . • • • • • (2m2 - l)miA/2 

(a) 


—>j 7712^/2 |<— 

0 « t % . % (TTli - l)7Il2A/2 


(b) 


-H miA/2 !■«- 

miA/2 ■ ■ ■ . a (2m2 - l)miA/2 


(C) 


Fig. 2: Geometry of the dense array (a), and co-prime suharrays (h), (c). At mi = 11 and m 2 = 9, 
(2m2 - l)miA/2 = 187A/2. 
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A. Parameterized Mean Case 

In this case, the Monte Carlo simulation consists of 200 independent realizations of the measurement 
vector y for a dense array of 188 elements, each for a single snapshot (M = 1). Then we compress 
these measurements to simulate the data for the co-prime compressed array of 28 elements with mi = 11 
and m 2 = 9. The compression ratio is ^ 6.7. Figure shows the MSE for the maximum likelihood 

estimator of the source at 9i in the presence of the interfering source at 02- The CRB corresponding to 
the 188-element dense array is also shown in this figure as a reference for performance analysis. Figure 
also shows approximations to the MSE (in starred solid lines) obtained using the method of intervals 
(introduced in ll23]l and used in |l2]|). At each SNR, the approximate MSE is computed as 


cr|i — + (1 ~ Pss)ci'cR- 

Here, Pss is the prohahility of the suhspace swap as a function of SNR, which we approximate using 


the lower hound in (14i; is the value of the CRB as a function of SNR, and (Tq is the variance of 
the error given the occurrence of a suhspace swap. The justification for using this formula is that when 
a suhspace swap does not occur, MSE almost follows the CRB . However, given the occurrence of the 
suhspace swap (and in the absence of any prior knowledge) the error in estimating the electrical angle 9i 
may be taken to be uniformly distributed between (—7r/2,7r/2) and the error variance is cig = 7r^/12. 

Figure|^shows that performance loss, measured by onset of threshold effect is approximately lOlogign/m. 
Our approximations on MSE also predict the same SNR difference in the onset of the performance 
breakdown. Figure shows our bounds on the probability of a subspace swap for the dense and co-prime 
arrays which are obtained using event F in Section III The ME curves of Figure would approach the 
CRB at high SNR were it not for the quantization of our ME simulation code. 


B. Parameterized Covariance Case 

We conduct the same set of Monte Carlo simulations for the stochastic data model. Here we draw 
M = 200 independent snapshots for a dense array of 36 elements over 200 independent realizations, and 
compress them to simulate the data for the co-prime array of 12 elements with mi = 5 and m 2 = 4. The 
compression ratio is ^ = 3. Figure shows the results for the MSE of the maximum likelihood estimator 
of the source at 0i = 0 in the presence of the interfering source at 02 = vr/36. Our approximations for 
the MSE using the method of intervals in ([30]) and the Cramer-Rao bound are also shown for each 
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- ML: Co-prime 

• Event F; Co-prime 
ML: Dense 

• Event F: Dense 

- - - CRB: Co-prime 

- - - CRB: Dense 


-15 -10 -5 

SNR (dB) 


Fig. 3: Parameterized mean case. Dense 188 element array and 28 element co-prime array. MSE bounds 
and MSE for ME estimation of 0i = 0 in the presence of an interfering source at 62 = 7r/188; 200 trials. 



Eig. 4: Parameterized mean case. Analytical lower bounds (event F) for the probability of subspace swap 
for estimation of the angle of a source at = 0 in the presence of an interfering source at 62 = 7r/188 
using 188 element dense array and 28 element co-prime array. 
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array. Figure shows that performance loss, measured hy onset of threshold effect is approximately 


lOlogigir/m. Our hounds on the prohahility of a suhspace swap using event G in Section III are shown 
in Figure for the dense and co-prime arrays. 



Fig. 5: Parameterized covariance case. Dense 36 element array and 12 element co-prime array. MSB 
hounds and MSB for MB estimation of 0i = 0 in the presence of an interfering source at 62 = vr/36; 
200 snapshots and 200 trials. 


V. Conclusion 

We have addressed the effect of compression on the prohahility of a suhspace swap. A suhspace swap is 
known to he the main source of performance breakdown in maximum likelihood parameter estimation, 
wherein one or more modes of a noise suhspace hetter approximate a measurement than one or more 
modes of a signal suhspace. We have derived an analytical hound on this prohahility for two measurement 
models. In the first-order model, the parameters modulate the mean of a set of complex i.i.d. multivariate 
normal measurements. In the second-order model, the parameters to he estimated modulate a covariance 
matrix. Our lower hounds take the form of tail prohahilities of F-distrihutions. They may he used to 
predict the threshold SNR. At a compression ratio of C, our numerical experiments show that the threshold 
SNR increases hy about lOlog^gC' dB when estimating a broadside source DOA in interference located 
at half the Rayleigh limit of the pre-compressed array. 
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Fig. 6 : Parameterized covariance case. Analytical lower bounds (event G) for the probability of a subspace 
swap using co-prime compression for the estimation of the angle of a source at 6*1 = 0 in the presence 
of an interfering source at 02 = 7r/36 using 36 element dense array and 12 element co-prime array. 
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